Applying the ISO 9126 quality model to test specifications - exemplified for TTCN-3 test specifications
نویسندگان
چکیده
Quality models are needed to evaluate and set goals for the quality of a software product. The international ISO/IEC standard 9126 defines a general quality model for software products. Software is developed in different domains and the usage of the ISO/IEC quality model requires an instantiation for each concrete domain. One special domain is the development and maintenance of test specifications. Test specifications for testing, e.g. the Internet Protocol version 6 (IPv6) or the Session Initiation Protocol (SIP), reach sizes of more than 40.000 lines of test code. Such large test specifications require strict quality assurance. In this paper, we present an adaptation of the ISO/IEC 9126 quality model to test specifications and show its instantiation for test specifications written in the Testing and Test Control Notation (TTCN-3). Example measurements of the standardised SIP test suite demonstrate the applicability of our approach.
منابع مشابه
Test software quality issues and connections to international standards
This paper examines how ISO/IEC 9126-1 and ISO/IEC 25010 quality models can be applied to software testing products in industrial environment. We present a set of code smells for test systems written in TTCN-3 and their categorization according to quality model standards. We demonstrate our measurements on industrial and ETSI projects, and provide a method for estimating their effects on produc...
متن کاملµTTCN - an approach to continuous signals in TTCN-3
Today, development and implementation of automotive embedded systems is based on a model-based process. A major problem of respective model-based toolchains can be traced back to inadequate testing tools, which often are not standardized, incomplete and cumbersome in usage. Due to these shortcomings, test specifications are neither exchangeable nor reuseable. In this paper, we propose μTTCN for...
متن کاملRefactoring for TTCN-3 Test Suites
Experience with the development and maintenance of test suites has shown that the Testing and Test Control Notation (TTCN-3) provides very good concepts for adequate test specification. However, experience has also demonstrated that during either the migration of legacy test suites to TTCN-3, or the development of large TTCN-3 test specifications, users have found it is difficult to construct T...
متن کاملAutomation of Refactoring and Refactoring Suggestions for TTCN-3 Test Suites. The TRex TTCN-3 Refactoring and Metrics Tool
Refactoring is not only useful for source code of implementations, but as well for test specifications. The open source TRex tool automates the application of refactorings and the detection of refactoring opportunities for test suites that are specified using the standardised Testing and Test Control Notation (TTCN-3). Depending on the refactoring, the behaviour preserving transformations may i...
متن کاملRefactoring and Metrics for TTCN-3 Test Suites
Experience with the development and maintenance of test suites has shown that the Testing and Test Control Notation (TTCN-3) provides very good concepts for adequate test specification. However, experience has also demonstrated that during either the migration of legacy test suites to TTCN-3, or the development of large TTCN-3 test specifications, users have found it is difficult to construct T...
متن کامل